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Abstract 

We define a language-independent model of nondeterministic quantum 
programs in which a quantum program consists of a finite set of quantum 
processes. These processes are represented by quantum Markov chains 
over the common state space. An execution of a nondeterministic quan- 
tum program is modeled by a sequence of actions of individual processes. 
These actions are described by super-operators on the state Hilbert space. 
At each step of an execution, a process is chosen nondeterministically to 
perform the next action. 

A characterization of reachable space and a characterization of diverg- 
ing states of a nondeterministic quantum program are presented. We 
establish a zero-one law for termination probability of the states in the 
reachable space of a nondeterministic quantum program. A combination 
of these results leads to a necessary and sufficient condition for termina- 
tion of nondeterministic quantum programs. Based on this condition, an 
algorithm is found for checking termination of nondeterministic quantum 
programs within a fixed finite-dimensional state space. 

A striking difference between nondeterministic classical and quantum 
programs is shown by example: it is possible that each of several quan- 
tum programs simulates the same classical program which terminates with 
probability 1, but the nondeterministic program consisting of them termi- 
nates with probability due to the interference carried in the execution 
of them. 



1 Introduction 

Quantum algorithms are usually expressed at the very low-level of quantum 
circuits. As pointed out by Abramsky [I], high-level, conceptual methods are 
needed for designing, programming and reasoning about quantum computa- 
tional systems. Along this line, intensive research on quantum programming 
has been conducted in the last 15 years. Several quantum programming lan- 
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guages have been denned, including QCL by Omer [T7], qGCL by Sanders 
and Zuliani [18], a quantum extension of C++ by Betteli et al. [5], QPL by 
Selinger [JJ5], and QML by Altenkirch and Grattage [3J. The operational or 
denotational semantics of these languages have been introduced. D'Hondt and 
Panangaden |8. proposed the notion of quantum weakest precondition, and then 
a predicate transformer semantics of quantum programs was presented in |23j . 
Also, several proof systems for verification of quantum programs have been 
developed [U [7J [22] > and some approaches to the implementation of quan- 
tum programming languages have been suggested [TH1 [2H 123 125] . Furthermore, 
several quantum process algebras have been proposed: CQP by Gay and Na- 
garajan [T2], QAlg by Jorrand and Lalire [T3] and qCCS [TO] , to model quantum 
communication and concurrency. For a more systematic exposition, we refer to 
two excellent survey papers [IT] [20] . 

Nondeterminism provides an important high-level feature in classical com- 
putation for specifying programs' behavior, without having to specify details of 
implementations. Zuliani [26) found a way for embedding nondeterminism into 
his quantum programming language qGCL, and then used qGCL equipped with 
a nondeterministic choice constrct to model and reason about Mitchison and 
Josza's counterfactual computation [15] and quantum systems in mixed states. 
In this paper, we consider a class of nondeterministic quantum programs dchncd 
in a language-independent way. A nondeterministic quantum program consists 
of a collection of quantum processes. These processes are described by quantum 
Markov chains over the common state space. This model of nondeterministic 
quantum programs is indeed a quantum generalization of Markov decision pro- 
cesses, which are widely used in the studies of probabilistic programs, see for 
example [13] . 

This paper focuses on the termination problem of nondeterministic quantum 
programs within a hxed hnite-dimensional state space. The paper is organized 
as follows. In Sec. [2] we briefly review the basic notions from quantum theory 
required in this paper, with an emphasis on hxing notations. In Sec. [3] a model 
of nondeterministic quantum programs is defined in terms of quantum Markov 
chains. In this model, an execution of a nondeterministic quantum program is 
a sequence of actions of individual processes, and following Selinger [T3] these 
actions are depicted by super-operators on the state Hilbert space. At each step 
of an execution, a process is chosen nondctcrministically to perform the next 
action. We define the termination probability of a nondeterministic quantum 
program starting in a state according to an execution schedule. Then the ter- 
mination of a nondeterministic quantum program is defined to be the infimum 
of its termination probabilities over all possible schedules. At the end of this 
section, we consider an example of nondeterministic quantum program consist- 
ing of two quantum walks on a graph (2] . This example is interesting because it 
indicates a striking difference between nondeterministic classical and quantum 
programs: it is possible that each of several quantum programs simulates the 
same classical program which terminates with probability 1, but the nondeter- 
ministic program consisting of them terminates with probability due to the 
interference carried in the execution of them. In Sec. [4j we examine the reach- 
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able space of a nondeterministic quantum program. By taking the arithmetic 
average of the super-operators performed by individual processes, we are able 
to define a deterministic quantum program whose reachable space is equal to 
the reachable space of the original nondeterministic program. Furthermore, the 
reachable space of the average deterministic program can be obtained by recur- 
sively constructing a finite increasing sequence of subspaces of the state Hilbert 
space. The notions of terminating and diverging states of a nondeterministic 
quantum program are introduced in Sec. [5j The structures of the sets of termi- 
nating and diverging states are clarified. In particular, it is shown that the space 
of diverging pure states can also be recursively constructed in a finite number of 
steps. In Sec. [51 the Hart-Sharir-Pnueli zero-one law for probabilistic concurrent 
programs [13] is generalized to the case of nondeterministic quantum programs. 
This quantum zero-one law enables us to discover an algorithmically checkable 
termination condition for nondeterministic quantum programs in terms of reach- 
able space and diverging pure states. A classical (not quantum) algorithm for 
termination checking of nondeterministic quantum programs is then presented 
in Sec. [7J A brief conclusion is drawn in Sec. [5] 

2 Preliminaries and Notations 

We assume that the reader is familiar with basic quantum theory, and the main 
aim of this section is to fix notations. 

2.1 Quantum states 

In quantum mechanics, the state space of a physical system is described by a 
complex Hilbert space W. In this paper, we only consider finite-dimensional 
Hilbert spaces. We write dim'H for the dimension of space %. A pure state of 
a system is represented by a unit vector in the state space of the system, and 
a mixed state by a (partial) density operator, that is, a positive semi-definite 
matrix p with its trace tr(p) < 1. We write T){Ji) for the set of (partial) density 
operators on %. For convenience, we simply write ip for the density operator 
corresponding to pure state \ip), that is, ip = IV'XV'I- For any two density 
operators p and a, their distance is defined to be || p — a ||*, where 

|| M ||*= tr(VMMt) 
is the trace norm of M for all operators M. Let 

P = ^\Hi){i>i\ 

i 

be the spectral decomposition of density operator p. The subspace span{|i/>i)} 
is called the support of /?, written suppp. Recall that for a family {Xi} of 
subspaces of H, the join of {Xi} is defined by 

\/X i = apan([jX i ), 

i i 
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and we write X V Y for the join of two subspaces X and Y. Then it is easy to 
verify that for any two states p, a £ T>{%), 

supp(p + a) = supp(,o) V supp(cr). 
2.2 Quantum operations 

Super-operators formalize physical transformations between quantum states. A 
super-operator £ on a Hilbert space H is a linear map from linear operators on 
H to themselves satisfying the following two conditions: 

1. Completely positive: for any a extra state space H' and any positive 
semi-definite operator P £ V(H' (I®£){P) is always positive semi- 
definite, where I : B(H') — > B(H') is the identity super-operator; 

2. Trace-preserving: for any p £ V{H), tr{£(p)) = tr(p). 

The Kraus representation theorem asserts that a linear map £ is a super- 
operator iff there are linear operators Ei such that 

£{p) = Y,Ei P E\ 

i 

for all p £ V(H), and 

i 

where Idu is the identity operator on H. 

For any subspace X of H, we define the image of X under £ as 

£{X)= \/ su PP £(^). 

In other words, if we write Px for the projection operator of X, then £{X) = 
supp£(Px)- Using the Kraus representation, it is easy to verify that £(supp(p)) = 
supp£(p). We can also define the pre- image of X under £ by 

£^{X) = £ %|supp£(V>) C X}. 

It is actually the maximal subspace Y satisfying that £{Y) C X. We write X 
for the orthogonal complement of a subspace X, then it is also easy to verify 
that 

£-\X) = (£*(X ± )) ± , 

where the super-operator 

£*(-) = Y,Et-E l 

i 

is the Schrodinger-Heisenberg dual of 

£{-) = Y J E i -El 
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2.3 Quantum measurements 



To acquire information about a quantum system, a measurement must be per- 
formed on it. A quantum measurement on a system with state space T-L is 
described by a collection {Mj} of linear operators on % satisfying 

Y i M\M i = Idu, 

i 

where indices i stand for the outcomes that may occur in the experiment. If 
the system is in state p G V(H) immediately before the measurement, then the 
probability that result i occurs is tr(MipMj), and the state of the system after 
the measurement is MipM- . 

3 A Model of Nondeterministic Quantum Pro- 
grams 

3.1 Basic Definitions 

Definition 1 Let H be a finite- dimensional Hilbert space which will be used as 
the state space of programs. A nondeterministic quantum program is a pair 

V = {{£ l : i = !,-■■ ,m},{M ,M 1 }), 

where: 

1. £i is a super- operator on % for each i = 1, • • • , m; 

2. {M ,Mi} is a measurement onW. 

There are m processes in the program V . The one-step running of process i is 
modeled by super-operator £i for each 1 < i < m. We will call V a deterministic 
quantum program when m = 1, that is, there is only one process in V '. 

We now see how a nondeterministic quantum program be executed. We first 
consider a single computation step of program V . It is achieved as follows: 

• Before each step, the measurement {Mo, Mi} is performed on the cur- 
rent state p to determine whether the program terminates or not. If the 
outcome is 0, the program terminates; Otherwise the program goes to 
complete a step then. 

• In each step, an element i is nondeterministically chosen from the index 
set {1,2,- •• , m} firstly, and then the operation £ t is performed on the 
current program state. Thus, the state becomes £i(M\pM\) after the 
measurement and the operation £j. 

A computation of a nondeterministic quantum program is a finite or infinite 
sequence of computation steps in which the same measurement is performed to 



5 



determine termination of the program in all steps, but the super-operators per- 
formed in different steps are usually different and they are nondetcrministically 
scheduled. Formally, the set of schedules of program V is defined to be 

S = {1,2,--. ,m}°° 

= {s\Si ■ ■ ■ Sfe ■ ■ ■ : Sfe e {1, 2, ■ ■ ■ , m} for all k > 0}. 

We also define the set of schedule fragments of V to be 

oo 

S /in = {l,2,... ,m}* = (J {1,2,- - - ,m} n . 

For convenience, we use e to represent empty string. For any / = s\ ■ ■ ■ s m £ 
Sfin, we write |/| for the length of /, that is, |/| = m. For each n < |/|, /(< n) 
stands for the head s\ ■ ■ ■ s n of /. We also write the head 

s(< n) = sis 2 ■ • • s n £ Sfi n 

and the tail 

s(> n) = s n+ \s n+ 2 ■■ ■ £ S 

of s = S1S2 ■ ■ ■ £ S for each n > 0. For any s = S1S2 ■ ■ ■ £ S and / = s[ ■ ■ ■ s' m £ 
Sfin, we write fs for the concatenation of / and s, that is, the schedule 

fs = s[ ■ ■ ■ s^sis 2 

For simplicity of presentation, we introduce the notation % which stands for 
the super-operator defined by 

Ti(p) = Si{M lP M\) 

for every p £ V(H) and 1 < i < m. Furthermore, for any / = sis 2 ■ ■ ■ s n £ Sfi n , 
we write: 

7/ = % n o • • • o T S2 o T Sl , 

in particular, T e (p) = p for all p. Let p £ V(H). If the input is state p, and 
program V is executed according to a schedule s = S1S2 • • • £ S, the program 
state after n steps is T s (< n ){p)- 

3.2 Termination Probability 

Suppose that the input state to program V is p. For any schedule fragment 
/ £ Sfi n7 we define the probability that the program terminates within / as 
follows: 

l/l 

tf(p) = ^tr(M r / (< n) (p)M t ). 

If the program is executed according to a schedule s — S1S2 • • • , it is easy to 
see that the probability of the program terminating in no more than n steps is 
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t s (<n)(p)- Furthermore, the probability that the program terminates in a finite 
number of steps is 

oo 

t s (p) = lim t a( < n) (p) = Vtr(M r s( <„)(p)M t ). 

n=0 

It is obvious that tr{p) > t s (p), and ir(p) — t s (p) is the divergence probability 
of the program starting in state p and executed according to schedule s. We 
can divide the termination probability t s (p) into two parts: 

• The first part is the probability of terminating in less than n steps, that 
is 



71-1 



(1) 



ts(<n-l)(p) = J2 tT ( M " r 4<k)(p)M^ 
fc=0 

- tr(p) - tr(M 1 T s( <„_i)(p)M 1 t ) 
= tr(p) -tr(7; ( <„)(p)) 

because all (i = 1, ...,m) are trace- preserving. 

The second part is the probability of terminating in at least n steps, that 
is 



Y^tx(M T s{ < k) {p)Ml) 



k—n 

oo 



(2) 



= ^tr(M!(r s „ +lS „ +2 ... s „ +fc oT s( <„ ) )(p)M 1 t ) 

fc=0 

= t s ( >n )(T s (< n )(p)). 

Combining the above two equations, we get that 

tr(p) - t s (p) = tr(T s( <„)(p)) - t s{>n) (T s{ < n) (pj). (3) 

This indicates that the divergence probability of a program is an invariant 
through an execution path of the program. 

In general, an execution along with any schedule s € S is possible for a 
nondeterministic program. So, we need to consider all possible execution paths 
of the program together. 

Definition 2 The termination probability of program V starting in state p is 

t{p)=mi{t s {p)\s&S}. 
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3.3 An Example: Quantum Walks 

We consider quantum walks on a graph. Let C4 = (V, E) be a circle with four 
vertices, where V = {0, 1, 2, 3} is the set of vertices, and E = {(0, 1), (1, 2), (2, 3), (3, 0)} 
is the set of edges. We first define a quantum walk on C 4 as follows: 

• The state Hilbert space is C v , and it has {\i)\i € V} as its computational 
basis; 

• The initial state is |0). This means that the walk start at the vertex 0; 

• A single step of the walk is defined by the unitary operator: 



It means that at any vertex, the probability of walking to the left and 
walking to the right are both 1/3, and there is also a probability 1/3 of 
not walking. 

• The termination measurement {Po,Pi} is defined by 

P = |2)(2|, P 1 =Id i -\2){2\, 

which means that there is an absorbing boundary at vertex 2. Here, Id.4 
is the 4x4 unit matrix. 

This quantum walk can be seen as a deterministic quantum program (Wi, {P , Pi}) 
starting in state |0). It is easy to verify that this program terminates with prob- 
ability 1, that is, f (|0)(0|) = 1. If the unitary operator W\ in the above quantum 
walk is replaced by: 
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H ' 2 = 7S 



then we get a new quantum walk, which can also be seen as a deterministic 
quantum program (W 2 , {P ,Pi}) starting in state |0). This new quantum walk 
is terminating too. However, if we combine these two walks to form a nonde- 
terministic quantum program ({Wi, W2}, {Po, Pi}), then it is not terminating 
when starting in state |0). In fact, since W2W1IO) = |0), it holds that 

t(|0)<0|)<t a (|0><0|)=0 
for the infinite execution path s = (12)°° = 121212 
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4 Reachable Space 

From now on, we consider a fixed nondeterministic quantum program 

V = ({£,: i = !,-■■ ,m},{M ,Mi}). 

Definition 3 1. The set of reachable states of program V starting in state p 
is 

R(p) = {T f (p)\f e S fm }. 

2. The reachable space of program V starting in state p is the subspace of H 
spanned by R{p), that is, 



Hr( P ) = V{ SU PP Cr l CT 6 R (P)}- 



We imagine that during the running of V , if each nondeterministic choice 
oi i G {1, 2, • • • , m} is made according to the uniform probability distribution, 
then then V actually implements a deterministic quantum program, which can 
be described as: 

Definition 4 The average ofV is the deterministic quantum program 

V = (£,{M ,M 1 }), 

where {M , Mi} is the same as in V , and £ is the arithmetic average of£i,£ 2} ••• , £ m , 
that is, 



m . 



for every p G T>{H). 
We define: 



T( fi ) - £(M lP M}) 



for every p <G T>(H). Then the reachable set and reachable space of V starting 
in state p are, respectively: 

R(p) = {T n {p)\n = 0,1,2,...}, 
^R( P ) = \J{snpp(a)\a eR(p)}. 

The following lemma shows that V and its average V have the same reachable 
space. 

Lemma 1 For any p G V(U), Hr( p ) = ^r( p )- 
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Proof: For each n > 0, we have: 

X! (T s „o.-or S2 or sl )(/)) 



m 

4=1 



m" 

Sl,S2)" - i s nES 



m" 

fes fin ,\f\=n 



Then the proof is completed by observing that 
U-R{ P ) = V su PP( r /(p)) 

OO 

= V \/ supp(7}(p)) 

n=0/€S /in ,|/|=n 

OO 

= \/supp(r"(p)) = ^ w .n 

n=0 

Now we only need to examine the reachable space H^ p y For every n > 0, 

we define H-^r \ to be the reachable space of program T 3 within n steps when 
starting in state p, that is, 

^R n{p) = V su P p(T fe (p)). 

Then it is clear that 

OO 

^fl(p) = V ^fln(p)' 

On the other hand, all elements of the increasing chain 

' H R 1 (p) ^ W fl 2 (p) - 

are subspace of finite-dimensional space H. There must be some n > such 
that T^R^p) = ^R fc (p) f° r an k > n, and thus = ^R n ( p )- Furthermore, 

we have a recursive characterization of reachable spaces ^ . 

Lemma 2 For a// n > 0, we /icrae: 
Proof: It holds that 

su PP r" +1 (p) = supp(r(r"(p„))) 

= T(su PP (T"(p))) c T{U nn(p) ). 
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So, we have: 

%„ +lW c^„ (p) vT(%„ w ). 
Conversely, it holds that 

n 

r(^ (p) ) = r(sup P (^r fe (p))) 

n n 

= su PP (r(^r fc (p))) = su PP (^r fc+1 (p)) 

k=0 k=0 

n+1 

= \/ S up P (T fc (p))cH w „ +lW . 

k=l 

Thus, we have: 

\ w vr(%(p))c\ +lW .o 

Now, we are able to prove the main result in this section. 

Theorem 1 If n is the smallest integer n satisfying = , p y then 

Kr(p) = ft -fl„( P )- 

Proof: By Lemma [TJ it suffices to show that 

ftfl„( P ) = ft"R n+1 ( P ) implies ftfl n+l(p) = ft>R„ +2 (p): 

which in turn implies "H-d / \ = ft"5 c n for all fc > 2. In fact, it follows 
from Lemma [2] that 

supp(r" +2 (p)) = sup P (r(r" +1 (p))) 

= r(supp(r" +1 (p)))cr(% n+i(p) ) 
= nn Sn ( fi ))cn Sn+lip) . 

Thus, we have H^ a(jt) = ^R n+1 ( P y D 

5 Terminating States and Diverging States 

Definition 5 1. For any p G T>{T-L), if t{p) = tr(p), then we say that p is a 
terminating state ofV. 

2. We write T for the set of terminating states ofV, that is, 
T = {peV(H)\t(p)=tt(p)}. 

The equality t(p) = tr(p) is usually called the terminating condition of pro- 
gram V . The intuitive meaning of this condition is that whenever the program 
starts in state p, it will terminate in a finite number of steps with probability 
1. Some basic properties of terminating states are collected in the following: 
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Lemma 3 1. p G T iff for all R(p) C T , that is, for all f G Sfi n , Tf{p) is a 
terminating state. 

2. Suppose that pi,p2 G T>{Ti) with p\ + p2 G T>(H). Then p\ + p 2 G T iff 
pi G T and p 2 G T. 

3. Let \ip) and \ip) be two pure states. If \tp), \ip) G T, then any pure state 
10 = a\tp) + b\(p) G T, where a, b G C. 

Proof: 

1. The "if part is obvious by putting / = e. To prove the "only if part, we 
assume that p G T. Then for any s G S, it follows from Eq. © that 

ir(7)(p)) - t s (T f (p)) = tr{p) ~ T /S (p) = 0. 

The arbitrariness of s implies that tr(Tf(p)) = t(Tf(p)). 

2. If pi G T and p 2 G T, then t{pf) = £r(/?i) (t = 1, 2), and 

ir(pi + p 2 ) > t{pi + p 2 ) = inf{t s (pi + p 2 )\s G S) 
= ml{t 8 { Pl ) + t s { P2 )\s G 5} > t(pi) + t(p 2 ) 
= tr(pi) + tr(p 2 ) = tr(pi + p 2 ). 

So, t(pi + p 2 ) = tr{fii + p 2 ), and p x + p 2 G T. 
Conversely, if p\ + p 2 G T, then for each s G 5, 

i s (pi) + i s (p 2 ) = * s (pi + Pi) 

= tr(pi + p 2 ) = tr(pi) + tr(p 2 ). 

Since t s (pi) < tr(pi) (i — 1, 2), it must be that t s {pf) — tr(pi) (i — 1, 2). 
Therefore, t{pf) = tr(pi), and pi G T (i = 1, 2). 

3. Put |0 = a\ip) + b\<p) and |f) = a\tp) - b\tp). Then we have: 

t(£ + O = *(l0<ei + l£'X£'l) 

= i(2|o|V + 2|6|V) = 2|a| 2 tr(V) + 2|fo| 2 tr(c^) 

= tr(0+tr(O=tr(C + O- 

Note that in the above equation, we slightly abuse the notation of density 
operator allowing unnormalization with trace greater than 1. This is not 
problematic because of linearity. So, £ + £' G T, and it follows from item 
2 that £ G T. □ 

Definition 6 7. For any p G T>(H), if for some schedule s £ S, we have 
t s (p) = 0, i/ien we say that p is a diverging state of V . 

2. We write D for the set of diverging states of V , that is, 

D = {pe V{H)\t s {p) = for some s G S}. 



12 



3. We write PD for the diverging pure state ofV, that is, 

PD = {\ip) e H\t s (ip) = for some s e S}. 

The remainder of this section is devoted to examine the structure of diverg- 
ing pure states PD, which is crucial in developing an algorithm for checking 
termination of program V in Sec. [7J To this end, we introduce some auxiliary 
notions: 

Definition 7 1. For each schedule fragment f € Sfi n , we define: 

PD f = men\t f (yj)=0}. 

2. For each n > 0, we define: 

PD n = |J PD f . 

/eS,i„,|/|=n 

3. For each schedule s G S , we define: 

PD s = {\i>)eH\t s (i)) = 0}. 

By definition, we have: 



PD=\J PD S 



s£S 



For any s € S and n\ > ri2, It holds that PZ3 s (< ni ) C PZ? S (<„ 2 ) because 
t s (<ni) > ts(<n 2 )- Furthermore, we have: 

oo 

PD S = fl PD s{ < n) (4) 

since t s (-) = limn^oo i s( <„)(-)- 
Lemma 4 For any f € Sfi n , we have: 

1. PDf is a subspace ofH. 

2. Let 

n = m\M^) = {)} 

be the orthogonal complementary subspace of measurement operator Mq. 
Then PDf C Hq. 

3. For each k G {1, 2, • • • , m}, 

PD kf = H nr k 7 1 (PD f ) (5) 

Proof: 
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1. Let \<p) be any two states in PDf, and |£) = a\ip) +b\tp) be any linear 
superposition of them. Write = a\ip) — b\(p). Then 

tf(0 + tfiO = t f {£ + C) = t f {2\a\ 2 i> + 2|6|V) 
= 2|a| 2 t / (^) + 2|6| 2 i / (^)=0. 

Thus tf(£) = and |£) 6 PDf- 

2. Noting that Hq = PD e , it is obvious. 

3. For any £ Hq n T^iPDf), we have tr(T fc (») = tr(^) for |V>) € W , 
and suppT fc (?/') C PD/ for £ T k ~ 1 (PD f ). Then by Eq. Q, we obtain: 

= t f (T k (ip)) = tx(T k (ip)) - tr(Mi7>(T fc (V'))M 1 t ) 
= tr(V») - tr(Mi7fe/(V>)-^i) = ife/W- 
Thus |i/>) € PD k f. It implies that 

HonT^iPD^CPDkf. 

Conversely, for any |i/>) g PDkf C we have tr(7fc(V0) = tr(V') and 
then 

= = tr(V^) - triAhTkfWMl) 

= ix(T k (S>)) ~ tT ( M iTf{Tk(i>))Ml) = t f (TkW)). 

Therefore, \tp) £ T^ X {PDf). We obtain: 

PDkfCUonT^iPDf). a 

We see that PD S is a subspace of Ho for every s € 5 by combining Eq. Q 
and Lemma 2J 

Lemma 5 

oo 

p£> = p| PD n . 

n=0 

Proof: For any state £ PD, there is some s £ S such that 

H>) e pd s c P£> s (< n) c pp„ 

for all n > 0. Thus, 



P£>cp|P£>„ 



Conversely, we prove that f]PD n C PD. Suppose that £ P-D ra for all 
n > 0. Put 

* = {/ e S>i»|t/(V) = 0}. 
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Then what we need to do is to find some schedule s £ S such that s(< n) £ X 
for all n. To this end, put 

Ef = {g £ X\f is a prefix of g} 

for each / £ S/m- We consider the set 

X' = {/ £ Sfin\Ef is an infinite set}. 

It holds that X' C X since Ef = for all / ^ X. So, it suffices to find some 
s 6 S such that s(< n) € X' for all n. Now we are going to construct such 
a schedule s, and our strategy is to define the head s(< n) of s by induction 
on n. First, s(< 0) = e £ X' as P e = X is an infinite set. Suppose that 
s(< n) = sis 2 ■ ■ ■ s n £ X' is already defined. Then there must be some s n +i £ 
{1, 2, • • • , m} such that s(< n + 1) = sis 2 • • • s„s„ + i £ X' . This is because 

m 

E s (<n) = {s{< n)} U |J S s (< n)i 

is an infinite set, and thus at least one of £ s (<„)i, E s r <n \ 2 , • • • , -E s (<„) m should 
be an infinite set. □ 

It is also easy to verify that for any n, PD n+ \ C PD n . On the other hand, 
each PD n is the union of a finite number of subspaces of H. The following 
technical lemma will help us to further clarify the structure of PD. 

Lemma 6 Suppose that Xk is the union of a finite number of subspaces of H 
for all k > 1 . If Xi D X 2 2 • • • 2 Xk 2 ■ ■ ■ , then there exists n > 1 such that 
X k = X n for all k> n. 

Proof: If for some k > 1, Xk = 0, then the result is obvious. So we can 
assume that Xk ^ for all k > 1. It suffices for us to prove the lemma 
for a special case that X\ is a single subspace of H, and then the general 
case can be obtained by putting Xq — H and considering the extended chain 
X D X x D • • • D X fc D • • • . 

Now, we prove the special case by induction on dimXi. First, for dimXi = 
0, Xk = {0} for all k and the result holds. For dimXi > 1, we only need to 
consider the nontrivial case that Xi ^ X\ for some I. We choose the minimum 
one of such I, then X\ = X 2 = ■ ■ ■ = Xi_\ and Xi is a proper subset of X\. Let 
Xi = Ui=i Pi> where P\,P 2 , - ■ ■ ,Pb are subspaces of H. Then for all k > I, 

b 

Xk=X k C\Xi = \J(X k DP t ), 

i—i 

and for each i £ {1, 2, • • • , b}, Pi is a proper subspace of X\ and we have dim Pj < 
dimXi. Therefore, noting that n Pi is still a finite union of subspaces, by 
induction hypothesis, the descending chain Pj D Xi + \ (~l P» 2 H Pi 2 
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terminates at some rij > I, that is n Pi = X ni n Pi for all fc > rij. Let 
n = max{rii : i = 1, 2, • • • , I}, then for all k > n we have 

b b 

x k = \J(X k n Pi) = |J(x„ n p) = x„. □ 

i=l i=l 

Now we can assert that there exists n > such that PDk = PD n for all 
k > n, and thus PD — PD n by combining Lemmas 2J [SJandlHl Indeed, we are 
able to prove an even stronger result presented in the following: 

Theorem 2 Let n be the smallest integer satisfying PD n = PD n+ i. Then 
PD = PD n . 

Proof: We only need to prove that for any n > 0, PD n = PD n+ i implies 
PD n+ i = PD n+ 2- Assume that PD n = PD n+ i and \ip) e PD n+1 . We are 
going to show that € PD n+ 2- By definition, there is / = S1S2 • • • s n +i G 
S 1 /™ such that \ip) £ PP>f- Put /' = s 2 s 3 ■ ■ ■ s n+ i. By Eq. (|5]), we have 
supp (T Sl (i/j)) C PDf. On the other hand, it follows from the assumption that 

P£> /( C P^„ = PD n+1 = |J P^g. 

gESf in ,\g\=n+l 

Since P-D/' and all PD g s are subspaces of the finite dimensional Hilbert space 
H, and a finite-dimensional Hilbert space cannot be the union of its proper 
subspaces (see Theorem 1.2 of [28 for reference), there must be some g = 
T\T2 ■ ■ ■ r n +\ £ Sfi n such that PDf> — PDf> n PD g and thus supp(7^ 1 (ip)) C 
PP g . We have € T^[ 1 {PD g ). Furthermore, we put (/ = s\rxT2 ■ ■ ■ r n+ \. 
Then by Eq. ©, \ip) £ PD g , C PP n+2 . □ 

6 Quantum Zero- One Law 

For simplicity of presentation, from now on, we only consider normalized input 
state p, that is, we always assume that tr(p) = 1. 

Definition 8 The reachable termination probability of program V starting in 
state p is the infimum of termination probability of the program starting in a 
state reachable from p, that is, 

h{p) = M{t(a)\a £ V(H R{p) )M<r) = !}• 

The following lemma gives a characterization of terminating states in terms 
of reachable termination probability. It is obviously a strengthening of Lemma|31 1 

Lemma 7 p£T (i.e. t(p) — 1) if and only if h(p) = 1. 
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Proof: The "only if part is obvious. To prove the "if part, we assume that 
h(p) = 1. Then for any / 6 S/m, it follows from Lemma[3]l that t(Tj(p)) = 1. 
Since 7/(p) can be decomposed as a convex combination of its eigenvectors, by 
Lemma |3l2 we see that t(ip) = 1 whenever is an eigenvectors of 7/(p). We 
write: 

Vr{ p ) = {eigenvectors of Tf(p)\f G S fm }. 

Then Hr( p ) — spanV^^), and Lemma[3]3 implies t(ip) — 1 for any € Hr( p )- 
Finally, for all cr G T>{'Hr^), since it is a convex combination of pure states 
in T-Lr[ p ), we assert that t{a) = 1 by using Lemma [312 once again. Therefore, 
h(p) = 1. □ 

To prove the zero-one law for reachable termination probability, we need 
the following technical lemma. It is obvious by definition that the reachable 
set is closed under 7/, that is, Tj{R{p)) C R{p) for every / € S/i n . The same 
conclusion is valid for the reachable space but no so obvious. 

Lemma 8 If p € T>(Hr( p )), then for any f <E %„, 7/0?) € V(Hr( p )). 

Proof: As T-Lr( p ) is finite-dimensional, we can find a finite subset F of 5/j n 
such that 

n R(p) = V su PP( r g(p))- 

g£F 

Thus, for any a G T2(Hr{ p ))<, there exists some positive real number A such that 

o< a^t 3 (p). 

Let 

5 = \Y J T g ( P )-o-eV{U R{p) ). 

geF 

Then for any k G {1, 2, • • • , m}, 

7i(ff) + %(S) = %(cj + 6) =%(\J2 T g (p)) 

gdF 

= A^T^(p)e^ %) ). 

g£F 

So, we have 7fc(c) G V{J-L R ^). Moreover, we obtain 7/(c) G T>('Hri p \) for any 
f = k\ ■ ■ ■ k m G S/in by induction on m. □ 

Now we are ready to present the main result in this section. 

Theorem 3 (Zero-One Law) For any p, we have h(p) =0 or 1. 

Proof: We write h = and argue that h > implies h = 1. Assume 
ft, > 0. Then for any e > 0, there exists some a G T>(Hr( p )) such that tr(er) = 1 
and h < t s (a) < h + eioi some s £ S. We can choose a sufficiently large integer 
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n such that t s (< n -i) (f) > ft/2 because linin^oo t s (< n )(c) = t s (o") > ft- Applying 
Eq. (P), we get: 

1 - tr(T s( < n) (a)) = *.(<„_!) (a) > ft/2. (6) 

On the other hand, we put A = tr(T s (<n)( cr ))- Then it follows from Lemma[5] 
that ^ 

jT s{ < n) (a) e V{U R{p) ). 

Also, it holds that tr[jT s (< n ) (cr)] = 1. So, by the definition of h{p) we have 
t(jT s (< n ){v)) > ft- Consequently, 

i s(>n)('7^(<„)(o')) > t(T s (< n ){cr)) = At(-7^(<„)(cr)) 

> Aft = ft ■ tr(7^(<„) (ct)). 

Then employing Eq. ([3]), we obtain: 

h + e> t s (a) = 1 - tr(7^(< n ) (cr)) + t s (>„)(7^(<„)(o-)) 
> 1 - tr(7^(<„)(o-)) + ft • tr(7^(<„)(o-)). 

Now combining Eqs. ^ and (O yields: 

£ >(l-ft)(l-tr(r s (<„)(c7)))>(l-ft)^. 

Finally, as e can be arbitrarily small, it holds that h = 1. □ 

From the definition of /i(p) we see that if h(p) = 1, then termination prob- 
ability t s (a) = 1 for any state a in the reachable space 'Hb.(p) °f P an( i an y 
schedule s £ S. What happens when h(p) = 0? The following proposition 
answers this question. 

Lemma 9 // h(p) = then there exists some a £ T>(Hr( p )) and s £ S such 
thatt s (a) = 0. 

Proof: The proof is divided into three steps. First, we show that if ft(p) = 
then t(a) = for some a £ V{Ji R ^. For any two states 5,8 £ 2?('Hfl(p)), and 
any s £ S, we have: 

t(5) <t s (5)=t s (e)+t s (5-6) 

< t 8 (0) + t s (y/(6 - Of ) < t s (9) + tTy/(6 - 6f ( 8 ) 

= t,(0)+ || 8 - 6 \\* 3{B U m t{6)+ || 6 - 9 ||» 

Since ft(p) = 0, we can find a sequence {a n } in such that i(<7„) — > 

(n — > oo). Furthermore, sequence {cr n } has an accumulation point a because 
T>(fl.R{ p )) is compact and satisfies the first countability axiom. Thus, there is a 
subsequence {<Ti k } of {a n }, which converges to a. It follows from Eq. © that 

t(o-) < *KJ+ || a - a ik (fc -> oo). 
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Second, we prove that if t(a) = 0, then there exists some 1 < k < m such 
that t(Tk(o~)) = 0. It suffices to see that for any seS, Eq. ([3]) yields: 

= t(a) > t s (a) = 1 - tr(T Sl (p)) + t s(>1) {T sl (p)) 

m 

> ts(>i)(T Sl (p)) > t(T Sl (p)) > mmt(T k (p)) 

Third, we show that if a G T~Lr( p ) satisfies t(a) = then t s (a) = for 
some schedule s £ S. We recursively construct s — S1S2 ■ ■ ■ G 5* such that 
t{T s {<n){v)) = for all n > 0. For n = 0, t(T e (a)) = t(a) = 0. Sup- 
pose that S1S2 ■ ■ ■ s n is already defined and t{T Sl s 2 ---s n (c)) = 0. Then ac- 
cording to the conclusion in the above paragraph, we can find such that 
t 0' S iS2---s n s n+1 ( (7 )) = t (T~s n+1 {T SlS2 ---s n (v))) = 0- Finally, we get: 

OO 

t s (cr) = J2 tT (MoT s (< n) (a)M^) = 

n=0 

because tr(M T s (< n ){<j)Ml) < t(7^(<„)(cr)) = for all n > 0. □ 

7 An Algorithm for Termination Checking 

A combination of the results obtained in Sec. QJ [S] and [5] leads to a necessary 
and sufficient condition for termination of program V . 

7.1 A Termination Condition 

Theorem 4 For any input state p, p G T (i.e. t(p) = 1) if and only ifHn(p) H 
PD = {0}. 

Proof: By the zero-one law (Theorem [3]) together with Lemma we only 
need to prove that h{p) = iff H R(p) DPD ^ {0}. UHr^OPD ^ {0}, then wc 
arbitrarily choose \tp) G Hr( p ) H PD, (ip\ip) = 1 and it holds that tp G T>{Jl R ^) 
and t(ip) = 0. Thus, by definition we have h(p) = 0. Conversely, if h(p) = 0, 
then it follows from Lemma [9] that there exist a G T>(T-Lr( p )) and s G S with 
t s (a) — 0. Now, let be an eigenvector of a. Then G Hr( p ) and t s (tp) = 0. 
This means that \ip) G ^ R(p) DPD^ {0}. □ 

Since we have shown in Sec. [S] that PD is a finite union of subspaces, the 
above condition can be checked by compute the intersections of subspaces pairs 
for given 7-Lr{ p ) and PD. Therefore, an algorithm for termination checking 
can be obtained by simply combining an algorithms for computing reachable 
states and an algorithm for computing diverging pure states, which are presented 
in the next two subsections. An application of these algorithms to checking 
termination of the example program considered in Sec. 13.31 is presented in the 
Appendix. 
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7.2 An Algorithm for Computing Reachable States 

Given a nondcterministic quantum program V and a initial state p, Algorithm [I] 
compute the reachable space 'Hr( p ) based on Theorem [TJ 

Algorithm 1: Computing Reachable States 
input : An orthonormal basis Bq of supp(/?), and a Kraus representation 

oiT(-) = E, r =i^-4 
output: An orthonormal basis B of 

set of states B ■<— 0; 

(* the number of elements of B *) 

integer I 0; 

(* the index of the state under considering *) 

integer i <— 1; 

(* put B to be Bq initially *) 

for | a;) € Bq do 

I <- 1 + 1; 

\bi) <- 

end 

while i < ^ do 

for j «— 1 to r do 

k)^-IM-EU(WIMIM; 

if \x) ^ then 

\k) <- |a;)/vW; 
B^BU{|6/)}; 
end 
end 

i <— i + 1; 
end 
return 



Correctness and complexity of the algorithm: Since B keeps to be a set of 
orthonormal states, I < dim'H always holds during the execution. Thus, the 
algorithm terminates after at most dim'H iterations of the while loop. Consider 
any execution of the algorithm. B = Bq at the beginning, and it is convenient to 
write Bi-i for the instance of B immediately before the iteration of while loop 
for i. Then spanS^ = span£?i_i U suppT(fci) C spaniel U 7"(spaxiSj_i). By 
LemmafSl it is easy to prove that spamBj C Hr.^ by induction on i. Then for 
the output B, we have span_B C H^tp). On the other hand, we have spani? = 
spamB U T(span_B) upon termination of the algorithm. Then ^ C span_B 
can be also proved for all n by induction. Therefore 'Hr( p ) = spanS. 

To get an upper bound of the running time of the algorithm, we write d = 
dim'H and consider each iteration of the while loop: There are r new states 



20 



\x) being calculated, and each calculation is done in time 0{d 2 ) by multiplying 
a d x d matrix and a (i-dimensional vector. Noting that r < d 2 , the time 
complexity is d ■ r ■ 0(d 2 ) = 0(d 5 ) in total. □ 

7.3 An Algorithm for Computing Diverging Pure States 

Algorithm [2] compute the set of diverging states for a given nondeterministic 
quantum program. The idea comes from Theorem [2] We calculate PD n from 
PD n _x, until the condition PD n = PD n _i holds. For convenience, we write 
J n = {PD f : f £ Sfi n , |/| = n} and thus Up e j„ p = PD n- Then to check if 
PD n = PD n -i, it suffices to check if for any P E J n -ii there exists Q € J n 
such that P C. Q. 



Algorithm 2: Computing Pure Diverging States 
input : The projection operator of Hq. 
output: A set of subspaces Jo- 
(*to record J n -i*) 
set of subspaces Jo 0; 
(*to record J n *) 
set of subspaces J\ <— {"Ho}; 
bool 6-^0; 
bool c <- 0; 
while -^b do 

Ji 0; 

for P g J do 

for k 1 to m do 

| Ji <- JiU{7;r 1 (P)nHo}; 

end 
end 

(*test if PD„ =P£> n _x*) 
6 4-1; 

for P £ J do 

c <- 0; 

for Q € Ji do 

| cf-cV(PCQ); 
end 

6 4- b A c; 
end 
end 

return Jo 



Correctness of the algorithm: We prove by induction on n that after the nth 
iteration of while loop, Ji becomes {PDf : f £ Sfi n , |/| = n}. For n = 0, 
Ji = {"Ho} = {PD e }. Suppose the result holds for n — 1. At the beginning of 
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the nth iteration, J <— J\ = {PDj : f 6 Sfi n , |/| = n — 1}, and then Ji is 
calculated from Jq by 



Here, PDkj = %o n T k 7 1 {PDf) comes from Eq. ([5]). So we get the correctness 
of the algorithm. □ 

It is worth noting that the termination of this algorithm comes from the de- 
scending chain condition in Lemma [SJ but the terminating time n is unbounded 
there. So, it is still unclear how to estimate the number of iterations of the 
while loop in Algorithm [2 and consequently the complexity of computing the 
set of diverging states of nondeterministic quantum programs remains unsettled. 

7.4 An example: Quantum Walks 

This subsection is a continuation of Sec. 13.31 We show how to apply our algo- 
rithms developed above to the nondeterministic quantum program {{W\ , W2}, {Pq, Pi})- 
In Sec. 13.31 we have shown that this program is not terminating for initial state 
|0) by observing a diverging path 1212 ■ ■ • . Here, we give an algorithmic check 
for this fact. 

Computing the reachable space: We use Algorithm [T] to compute the reach- 
able space "Hi?(|o)(o|)- The Kraus operators of T(-) are E\ = W\P\ and E2 — 
W2P1. We write B i} j and \xij) for the instance of B and |a;) respectively, for 
index i and index j during the execution. Then B is calculated by a finite 
number of iterations of while loop as follows: 

Initially we have 



Ji = {Ho n Tk\P) ■ 1 < k < m, P e Jo} 

= {Ho n T k 7\PD f ) : 1 < k < m, f € S fin , |/| 
= {PD kf :\<k<m,fe S fin , (/I = n - 1} 
= {PD f :feS fln ,\f\=n}. 



n - 1} 



B 



1. 

|0>, 

{IV}; 



for the iteration of i = 1, 
for j = 1, 



Bi|6 1 ) = (|0) + |l) + |3))/>/3, 
|x M ) = (|l) + |3))/V3^0, 



1=1 + 1 = 2, 
|6 2 ) = (|1) + |3))/V2, 
Si,i = {IM,|6a)}; 
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for j = 2, 

£ 2 |&i) = (|0)-|l> + |3»A/3, 

|*i,2> = (-|l> + |3»/v^0, 

I = 2 + 1 = 3, 

l&3> = (-|l) + |3»/V2, 

Bi,2 = {|6i>,|62),|6 3 )}; 

for the iteration of i = 2, 
for j = l, 

£i|& 2 > = (-|l>+2|2> + |3))/\/6, 

|a:2,i> = 2|2)/V6 ^ 0, 
Z = 3 + 1 = 4, 
IM = |2), 

B2,i = {|6i),|62),|63>,IM}; 

for j = 2, 

B2|&2) = (2|0) + |l)-|3))/>/6, 
1^2,2) = 0; 

for the iteration of i = 3, 
for j = 1, 

S 1 |6 3 > = (-2|0) + |l) + |3))/>/6 ) 
k3,i) =0; 

for j = 2, 

£ 2 |& 3 > = (-|l>-2|2>-|3»A/6, 
1*3,2) = 0; 

for the iteration of i — 4, 
for j = 1, 

E1I&4) =0, 
\x4.1) = 0; 

for j - 2, 

£ 2 |fe 4 ) =0, 
1^4,2) =0. 

So the output is 

B = {|0),(|l) + |3))/v^,(-|l) + |3))/A|2>}, 
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and the reachable space 'Hr(|o)(o|) = spanS is actually the whole state space. 

Computing the set of pure diverging states: We use Algorithm [2] to compute 
the set of pure diverging states PD. In the algorithm, PDf is recursively 
calculated by Eq. ([5]). Specifically, here we have 

T k (-)=W k P l -(W k P l ) 1 (fe = l,2) 

and then the projection operator of %q n T t 7 1 {P) is exactly P\ fl W^ l PWk- 
Now, we calculate each PDf recursively on |/| as follows: 
For |/| = 0, we initially have 

PD e = P 1 =Id 4 -\2}{2\; 

for |/| = 1, 

to compute PD\ we get that 

W 1 - 1 |2) = (|l) + |2) + |3))/A 
W{ l PD e W x = {W^\2)}^, 

then 

PDi = p t n w^pdjVi = |o)(o| + 1 — >< — U 

where |-) = (|1) - |3))/V2; 
to compute PZ?i we get that 

^ 2 - 1 |2) = (|l) + |2)-|3))/V3, 
Wz 1 PD e W 2 = {W 2 - 1 \2)} ± , 

then 

PD 2 = P 1 D W^ l PD e W 2 = |0)(0| + l+X+l, 

where |+) = (|1> + |3))/>/2; 
for \f\ = 2, 

to compute PDn we get that 

^r 1 |0) = (|0) + |l)-|3))/V3, 
Wr 1 |-) = (-|l> + 2|2)-|3))/V6, 

then 

P£> u = (|0) + |l)-|3))((0| + <l|-(3|)/3; 
to compute PD 2 \ we get that 

^ 2 ~ 1 |0) = (|0) + |1) + |3»/V3, 
^ 1 |-> = (-2|0> + |l) + |3))/V6, 
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then 



pd 21 = p 1 n w^PDiWi = |o)(o| + i+x+i; 

to compute PD 12 we get that 

VKr 1 |0)-(|0) + |l)-|3))/^, 
^r 1 |+) = (2|0)-|l) + |3))/V6, 

then 

PD 12 =P 1 n W^PD x Wx = |0> <0| + l-X-l; 
to compute PD22 we get that 

^ 2 - 1 |0)^(|0) + |l) + |3))/y3, 
^ 2 - 1 |+) = (|l)-2|2)-|3))/V6, 

then 

PD 2 2 = (|0) + |l) + |3))«0| + <l| + <3|)/3. 

Since PD 1 = PD 12 and PD 2 = PD 21 , we have PD = PD X U PD 2 . 
Finally, we get that 

Wfl ( |0>(0|) n PD = span{|0), |-)} U span{|0), |+)} ^ {0}. 

So, this program is not terminating. 

8 Conclusion 

In this paper, we defined a mathematic model of nondeterministic quantum pro- 
grams, in which a program consists of a collection of quantum processes, each 
process is represented by a quantum Markov chain over the common state space, 
and the execution of these processes are nondeterministically scheduled. The 
advantage of this model is that it is independent of the details of its implemen- 
tations so that we can focus our attention on examining high-level behaviors of 
nondeterministic quantum programs. In particular, a termination condition for 
nondeterministic quantum programs was found, and a classical (not quantum) 
algorithm for their termination checking was designed. To achieve these results, 
several new mathematical tools have been developed to attack the difficulty 
arising from the combined complexity of quantum setting and nondctcrminism: 

• We established a quantum zero-one law for termination probability of 
nondeterministic quantum programs. This law allows us to reduce the 
termination checking problem to emptiness checking of the intersection 
of the reachable space and the space of diverging pure states, instead of 
calculating the terminating probabilities over infinitely many execution 
schedules. 
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• We found an equivalence between the reachable space of a collection of 
super-operators and that of their arithmetic average. 

• It was shown that the descending chain condition holds for finite unions 
of subspaces of a finite-dimensional Hilbert space. This helps us to extend 
our proof techniques for a single subspace to the case of multiple subspaces, 
which are unavoidable when nondcterministic choices are present. 

For the further studies, an immediate topic is to extend the results presented 
in this paper to quantum concurrent programs where not all but only fair ex- 
ecution schedules are allowed. A major difficulty for such an extension comes 
from an essential difference between quantum concurrent programs and classi- 
cal (and probabilistic) concurrent programs. In the classical case, the behavior 
of a concurrent program can be visualized as a directed transition graph, in 
which only an ordering structure determined by transition relation exists. In 
the state space of a quantum concurrent program, however, a linear algebraic 
structure and a transition relation lives together. Those methods of searching in 
the state space of a classical (and probabilistic) concurrent program developed 
in the literature (see for example |13] ) are not effective in the quantum case 
because they usually violate the linear algebraic structure of the state space of 
a quantum program. It seems that a new theory of quantum graphs, where 
their linear algebraic and ordering structures are coordinated well, is essential 
for the studies of quantum concurrent programs. 
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